SoftBridge: A Multimodal Instant Messaging Bridging System
نویسندگان
چکیده
Instant Messaging is traditionally a text only affair. However, there are instances when it would be useful to bridge to other types of media, like speech. The SoftBridge is an application framework that enables this kind of communications bridging using instant messages. Its use of protocols like the Jabber Instant Messaging Protocol and the Simple Object Access Protocol makes it simple, open and extensible. It also allows bridging to non IP communications infrastructure, like the telephone network. We describe the design and architecture of the system, protocol and extensibility mechanism. Finally we describe our experimental methodology and discuss the results of our initial experiments. Keywords—instant messaging, bridging, XML, SOAP, Jabber, web services, speech synthesis, speech recognition, multimedia
منابع مشابه
SoftBridge in Action : The First Deaf Telephony Pilot
Recognition (ASR) utilities accessed via web services. To perform Action Research with the Deaf community in Cape Town, we invited a Deaf user (DU) to participate in a pilot study. We conducted three tests varying the input/output modalities of the hearing user (HU). The DU had a standard text in/text out Instant Messaging client. The HU client used the following specific modality combinations:...
متن کاملEffects of human agent service quality in an instant messaging decision support system on the customer's trust building
Bridging the trust-based decision-making theories with the SERVPERF framework, we introduce a new model to investigate the effects of human agent service quality of an Instant Messaging Decision Support System (IMDSS) on the customer’s trust and perceived risk before purchasing in a marketplace with uncertainties. We also introduce a new service quality measurement model, IM-SERVPERF, to fill t...
متن کاملShake2Talk: Multimodal Messaging for Interpersonal Communication
This paper explores the possibilities of using audio and haptics for interpersonal communication via mobile devices. Drawing on the literature on current messaging practises, a new concept for multimodal messaging has been designed and developed. The Shake2Talk system allows users to construct audio-tactile messages through simple gesture interactions, and send these messages to other people. S...
متن کاملEmotional facial sensing and multimodal fusion in a continuous 2D affective space
This paper deals with two main research focuses on Affective Computing: facial emotion recognition and multimodal fusion of affective information coming from different channels. The facial sensing system developed implements an emotional classification mechanism that combines, in a novel and robust manner, the five most commonly used classifiers in the field of affect sensing, obtaining at the ...
متن کاملExploring the Potential of a Mobile Messaging Application for Self-Initiated Language Learning
With the rapid expansion of deploying mobile instant messaging applications such as Telegram for the purpose of language learning, it is quite apparent that language research in this regard is lagging behind the trend. This study addressed the matter by exploring how language learners utilize a Telegram group for the purpose of language learning. In this regard, the activities of a Telegram lan...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003